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ABSTRACT 

Factors that affect the utility of financial data 
collected through the Higher Education General Information Surveys 
(HEGIS) are examined. Attention is also directed to the process 
associated with the collection and use of that data; roles and 
responsibilities of various 'parties to that process, with a focus on 
researchers' roles; and possible future steps to improve the 
usefulness of these data. The following factor s are identified as 
affecting the utility of HEGIS finance data: quality of the data, 
relevance of the data for decision-making, accessibility of the data, 
timeliness of the data, and cost-effectiveness of the data. Specific 
recommendations to improve the utility of HEGIS finance data are 
offered for provider institutions , the data collector institution, 
researcher, and users. The recommendations pertain to data collection 
design, data collection, editing, release, analysis, and use, are 
presented in detailed tabular form. (SW) 
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Foreword 



This report Is one of four written as part of the project cal led Assessing the 
Quality of the HEGIS Data. The oroject was supported by the National Institute 
of Education and was designed to study problems and Issues related to the 
quality of the data collected through the Higher Education General Information 
Survey (HEGIS) by the National Center for Education Statistics (NCES). There 
are five major surveys col lected annual ly, and three minor surveys col lected 
periodically. The major surveys are entitled Institutional Characteristics, 
Financial Statistics, Opening Fall Enrollment, Earned Degrees, and Employees. 
The periodic surveys are entitled Facilities, Residency and Migration, and 
Libraries. 

Frequently HEGIS data are needed to make comparisons between s»< as^ 
between Institutions, and between Institutional sectors. Since higher \ 
education Is so diverse, comparative analysis Is often difficult.' After \ 
reviewing previous work done In the area, this project examined HEGIS data foK^ 
their comparability, policy rel.evance, accuracy, and validity. To examine 
comparability, four studies were conducted through the Data Quality project: 
(1) the development of a new and Improved taxonomy for colleges and 
universities; (2). a study Investigating the Impact of medical schools on the 
financial statistics reported by Institutions; (3) a survey of state practices 
affecting the reporting of HEGIS data; and (4) an assessment of longitudinal 
changes In the reporting units of the HEGIS universe. To examine policy 
relevance, the project studied the utility of the data from a researcher's 
perspective. To examine accuracy and validity, the prbject conducted a study 
that suggested NCES could Improve the accuracy of the data by more extensive 
verification checks Identifying outlying Institutions through cross-survey 
measures. 1 

Four reports are. being made available to any Interested party; they are 
listed below by title and author. 

• "An Improved Taxonomy of Postsecondary Institutions" by David J. 
MakowskI and Rolf M. Wulfsberg 

• "Impact of Health Programs on I nstructlonal Expenditures In Higher 
Education" by John D. Smith 

o "State Reporting Practices and the Qual Ity of HEGIS Finance Data" by 
Jane N. Ryland 

• "The Utility of HEGIS Finance Data: A Researcher's Perspective" by 
Mar 1 1 y n McCoy < • 

Copies of the papers can be obtained by writing to: 

Data Qual Ity Project 
NCHEMS . 

P e d. Drawer P " 
Boulder, Colorado 80302 



Introduction 



The financial data collected by the National Center for Education Statistics 
(NCES) through Its Higher Education Genera! Information Surveys (hbbi&J 
represent the only onqolng source of financial Information about all higher 
education- institutions In the United States. Since this Is one of the few 
major surveys that collects finance data from Institutions on a national basis, 
efforts to Improve Its utility can be exported to have broad and major 
benefits. As a background to efforts to improve the HEGIS, this paper examines 
(a) the factors that affect the utility of this data set, (b) the process 
associated with the collection and use of that data, (c) the ro l es anC 
resnonslbtl ities of various parties to that process—focusing In particular on 
those of researchers-and -finally (d) possibl e 5±e^ f or the future to improve 
the usefulness of these data. This discussion is cast in broad rather than 
specific terms. It was felt that such an approach would provide a much needed 
background on which a subsequent examination of specific and detailed 
recommendations could be made. 

Utility of HEGIS Finance Data 

It is Important to review wh£r>actors affect the utility of any data set, 
since improvement? in utility are dependent oh these conditions. In the course 
of this the a- •■-'» (1) proposes her own set of factors, and (2) outlines 
specific steps 1, improve these factors. This list Is °ff ered + a ^ a start ng 
point for further input and development. It should.. a I so be noted that while 
these factors have been identified specifically In the context of HEGIS finance 
data, they can. In most cases, be generalized to other data collections. The 
following factors' are identified as affecting the utility of HEGIS finance 
data: 

• Qua I ity of • t ht> data 

« Relevance r the data 'or decisionmaking 
«3 Accessi bi I ' of the data 

• Timeliness of the data . 

• Cost-effectiveness of vhe data 

Each of these factors is discussed below. 

Quality of the Data in Reflecting the Financial Realities of H jgher-Education 
Institutions 

The purpose of gathering data that reflects financial conditions Is to 
' provide empirical evi^nce that depicts who provides which funds; how they are 
used; and what assets are 'accumu I ated. .Even at their best, such data are only 
an a bstraction of reality and thus never'as good as the reality itself. This 
recognition is important to consider as one seeks both to collect and use data 
depicting the finances or higher education. One must not assume that these ... 
data, despite the! r appearance of empirical concreteness, are more than they 
are As stated by Fe! leg! (1980), data collection typically involves 
compromises between i*e concept a decisionmaker might wish to measure (the 
ideal concept) and what I;; .-.ossfble and practical, to measure (the 
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operational I zed concept). Such diff iculties are endemic to dole col locHon and 
ore not easily resolved. A specific example In the context of HEGIS f I none I a I 
data would bo Instruction expenditures. As on Ideal concept, It Is clour that 
Instruction happens In s variety of settings (in the classroa.i, In the 
dormitory. In e lecture hall, in a language house, at a concert) using a 
variety of resources (faculty, other students, visiting lecturers, facilities, 
equipment, and time). Yet to represent these operational ly In this case, a 
•slnqlo medium (money) Is picked and somewhat arbitrarily certain portions of 
resources are allocated to this function (as opposed to doing precise studios 
of time and resource allocations) to reflect the extant of activity and costs 
In these areas. These al locations are made despite Joint product problems 
among Instruction, research, and other program arons in terms of faculty .ime, 
space, and equipment use, etc. 

The resulting data are therefore an abstraction of reality, and judgmonf- 
are needed about the quality of the data as an abstraction. Statistically, 
quality is traditionally judged in terms of the yal ldit y . of the data in . 
approximating reality, the rj»l lability of the data in repeatedly measuring that 
reality, and the accuracy of the data in terms of how closely it measures 
real Ity. 

NCES periodically conducts validation studies to assess data quality. In 
addition, various institutions, state agencies and other users have been 
concerned with assessing the quality of these data. Studies such as those 
conducted by Minter and by Andrews suggest that the quality of the HEGIS 
financial data is Improving. NCHEMS is developing a set of procedures that can 
be used to assess data quality in a broad way as new data tapes are acqu red. 
The procedures use a variety of common measures, for example, state and ocal 
appropriations per student. Instruction expenditures per student, operation and 
plant maintenance per assignable square feet, etc. to examine the data reported 
bv Institutions of various types In search of unusual values. If such values 
are found, NCES contacts the institutions to determine whether such occurrences 
are correct. 

Continuing efforts to assess data quality are needed. In those areas 
found to be problematic, NCES should consider (a) further c I ar i f icati on of 
definitions, (b) changes In existing survey forms in the categories used and 
(c) supplementary surveys where warranted. Through the pub I I ca tion of a ser es 
of guides by NCHEMS under NCES sponsorship, significant steps in th s direct ion 
have already been completed (Collier and Allen 1980; Allen 1980; Col I ier 1980) . 
An additional step of providing feedback to those reporting data (through 
Institutional profile reports developed using HEGIS financial and .other data) 
should also help. 

I ntegrity of data is a related dimension of data quality. All parties to 
the use of financial information must be assured,that the data have not been 
tampered with, either In collection or analysis, to serve local purposes, lo 
assure integrity, care must be taken .that data are not changed • 
arbitrarilv--that is, procedures governing all providers must be f ol I owed-that 
onlv recoqnized parties can submit and change data—that is, that there is a 
regular and designated provider of data- that the data are widely and general ly 
shared, and that the analysis performed is subjected to widespread scr ut . nj 
Clearly, the responsibility for the integrity of data is broadly 'distributed 
among providers, collectors, researchers and ultimately the users of these 
data. 



Kolevanco of Financial Dr.ta for Decisionmaking 

In higher education, there have recently boon a largo number of users of 
HEGIS financial data, Indicating that such Information Is highly relevant. AT 
Issue then Is whether there aro certain changes that should be made vo ncrease 
the relevance of this data sot to specific users. For NCES as b 9* n * r *\ 
statistical agency, attempting to serve many kinds of users, this task I- a 
part cu ar y difficult one. As a result, It must seek to assure that the 
process used In selecting data for collection and dissemination Is broadly 
representative of higher education. 



Accesslbl I Ity of Financial Data 

While HEGIS financial data are potentially relevant to a great many 
decisions In higher education, their accessibility for these decisions s not 
always apparent. Their existence may be unknown, the process of acqu ring them 
may be too complicated or expensive, or other factors may Interfere with their 
-use NCES has continued to experiment with a variety of dissemination 
strategies: EDSTAT, preliminary release newsletters, special reports computer 
tape distribution, etc. to increase the use of these data. The recent Increase 
In their use attests to the success NCES is achieving. However, the 
experiences of this researcher in using HEGIS financial data at a detailed 
level suggests that use of these data at this specific level is quite 
complicated. Steps involved are: (1) developing familiarity w th their 
content, (2) comprehending the documentation that Is provided with computer 
tapes (3) adjusting to changes In form and content of documentation, 14J 
Identifying which institutions are included from year to year, and how they are 
classified (as part of a system or as a separate campus), and (5) perceiving 
limitations in the data. These are all important tasks that precede actual use 
of the data for analysis. For many users, such an investment In time and 
effort is too costly. At issue then is whether NCES can accomp I I sh more of 
these tasks central ly as a way of encouraging greater use of these data. he 
collective experience of many researchers who have used these data could aid 
NCES In this process. 

/ 

Tlmel iness of the Data 

Timeliness Is well recognized as one of the most Important attributes of 
data. Timeliness requires that delay between the time data are collected, 
compiled and finally released be minimized. Such promptness, however, a so 
represents a tradeoff between a quick response that may produce unreliable 
data, and reliable figures that take too long to generate. 

NCES has substantially improved the timeliness of HEGIS financial data. 
To improve further the turnaround time, three suggestions are made: (1) NUib 
should continue to use the SHEEO Network to obtain more prompt responses from 
institutions, (2) NCES should consider shifting more of the editing 
responsibility to the state level, and (3) NCES should consider a standard 
sample of Institutions that are prompt respondents for calculating preliminary 
release figures. In addition, efforts by NCES to provide feedback to 
institutions in the form of institutional profiles would provide direct 
incentives to these institutions to participate more actively in submitting 
data to HEGIS. . - 
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Cost Ufoctlvoiiooii of Dntu 

Tho procoss of obtaining data Is. a continual balancing act bolwoon the 
coots of acquiring thorn and tho bonof Its of using thorn. I'lioso costs art) 
experienced among all parties— tho Institutions reporting tho data, NCto n 
collecting tho data, researchers In analysing tho data, and usora In obtaining , 
and applying the data. Those costs aro also Important to consider us part of 
any efforts to Improve dafa quality, relevancy, accessibility, and 1 Intel noss. 
Further elaborations In definitions, changes In procedures, and other efforts 
to Improve the accuracy of data all entail further costs. At Issuo hen Is 
determining what the proper balance Is betwoon Improvod precision and Its cost. 
The cost of personally watching each professor to calculate Instruction 
expenditures Is obviously too great. But what Is a reasonable cost? For 
Institutions, some of which never use these data, any costs are unreasonable. 
A better balance between costs and benefits Is warranted and Is associated with 
Increased use of these data. Tho provision of Institutional profiles Is one 
suggestion In this context to Improve tho benefit side of this oquatlon. 

The foregoing section has Identified some of the factors that affect the 
utility of data— that Is, data quality, relevance, accessibility, timeliness 
and cost-effectiveness. The next section examines how these data are collected 
and used as a basis for Identifying strategies to Improve this process. 
Improvements In the process thus provide the basis for Improvements In the 
ut 1 1 Ity of the data. 

Process of Data Collection and Use 

The process of collecting and using data Is obviously quite complex. This 
author has Identified at least sly major phases— data collection design, data 
collection, editing, release, analysis, and use— with a variety of substeps in 
each area (see figure 1). While the steps themselves are complicated enough, 
the process Is further complicated by the fact that: (a) al I the phases arfl 
Interrelated — for example, the editing stage affects analysis; use affects 
succeeding data collection designs, and (b) there are a I ajge number Of 
participants In this process— such as data providers, data collectors, 
researchers, and users, the actions of each affect the whole process. 

Efforts to Improve the utility of HEGIS finance data are, therefore, 
themselves necessarily complex. For example, changing a definition to provide 
greater comparability and hence improved use will have to be examined in light 
of its feasibility for reporting by institutions. Such changes, therefore, are 
dependent on the recognition of shared responslBll Itles among all participants 
In this process. In figure 1, the author has attempted to identify the 
relative roles of these four types of participants. 1 For example, the first 
step in data collection des I gn— enunc I at ion of need/use— is depicted as the , 
main responsibility of NCES-^a heavy responsibility of different users, and a 
lesser responsibility of data providers and researchers. A clarification of 
these roles among the, parties to this process is a beginning step for improving 
the process. 

IWhile ft qrate participant roles have been indicated, It should be noted 

that any li. .-al group may carry out multiple roles. For oxample, an 
institution may be a data provider, a researcher, and a data user, shifting 
roles at any given time. 
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Ilium tiro (i1 leant throo major nsp'oclo of thlt model of tho 
tlata-col loci lon-and-utH) procouo. Tho flrut Is. Hurt tho procouR of Improving 
lir.GIS limine I a I data Is on &mlMJjW.y,, «n<l nul o r evolutionary, nppronch. 
Tho Intordopondont and recurring noturo of this process suggests thai to bo 
offoctlvo, chongos and Improvements will nocoaour 1 1 y hove lo occur gradual y. 
Drastic changes In data collection procedures, for oxamplo, cunnol bo readily 
accommodated' "by Institutional Information systems Instantaneously. An altornpl 
lo forco a sudden change Is llkoly to bo Ignorod or ror.pondod to I nadoquatoly, 
A mora moasurod and sequential process lo thuv. required. Howovor, si I von tho 
do'.lr o and nood tor high quality Information, I ho doforrnl of improvements Is a 
frustrating oxporlonco roqulrlng participant?, to bo vory patlont. 



A nocond aspoct Is thai changes In tho process roqulro 
of coanilnotl.oxi Involving many different participants. Gofllng Iho attention 
and' active" support of those participants Is a major task In I 
onorqollc efforts of tho concerned parlies Is essential. Iho group thus 
dissembled In this mooting Is at least a starting point 
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Figure 1 

Model of the Data Collection and Uso Process 
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publ I cat ion schedule ~~ M Kl 



Format of release doslgnod 
to foci I Itato use 
Documentation of editing M 
Subsequent docurnontat Ion of 
later edits [\ 
Dissemination of forts ~ M 



M HI 



III M Hi 



V. Analysis 

• User, prov Ider, col loctor Input 
on mothodol ogy and data IH 

• F M o examination and structuring IS IS H 

• Unit of analysis (compar I son 
groups) IH H M 
Coniparobll Ity Issues . IH IH M 
Docurnontat Ion of methods 

and I Imitations ~~ " ™ 



Cautionary notes 



Feedback and 



Availability of supplementary 
and clarifying analysis 



revisions IH IH M IH 



VI. Use .r , c M IH 

• On-site clarification IS IS M m 



IH IH M IH 



• Understanding of limitations IH IH IH M 

• Involvement of local groups 

In use m 

• Feedback and revisions In 

data and methods . IH IH 

Fig. 1. Model of the Data Collection and Use Process 

Third, Improvements In the utility of HEGIS financial data will continue 
to occur only through continued jjsfi of these data. As Bertram Gross ,(1966) has 
stated, "the conclusion seems to be that rather than do nothing It Is 
preferable to start out with bad data, warn everyone about the defects and 
limitations, and aim at gradual Improvement through use" (p. xvl). While Htbib 
financial data have progressed substantially beyond thr Initial stages 
reflected In Gross' statement, that process of Improvement remains an 
evolutionary goal to be achieved through continuing use. To stop the use of 
these data In hope of future Improvements Is unlikely to serve that goal. 
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Uti I Ity of HEGIS Financial Data-- A Researcher's Perspecti ve 

While the foregoing sect Ions* have looked at the generic factors that 1 
affect the utility of HEGIS financial data and the process and participants 
involved in collecting and using that data, this section wH I identify some of 
the advantages and problems associated with using these data — from this 
researcher's perspecti ve. In addition, specific actions that have been taken 
in response to spec i f Ic prob I ems will be discussed. 

This researcher has been a user" of HEGIS data since 1974. NCHEMS has 
acquired a! I HEGIS tapes from 1971 to the present and uses these data 
extensively In the research programs of the Center as well as more recently to 
provide tailored data reports to Institutions and state agencies on request. 



Relevance of HEGIS Financial Data to Researchers 

Upon undertaking any research activity, the first decision to be made is 
whether to use existing data or to collect one^ own data set. There Is no 
question that use of- existing data will require compromises In research design 
A general statistical data set, such as HEGIS, Is unlikely to be an exact fit 
with the needs associated^ with a 'spec I f Ic research undertaking. This lack of 
exact fit will require certain assumptions and extrapolations and even perhaps 
some supplementary data collection.. However, the problems assoc iated^ with not 
using existing data and embarking oh. one's own col lection effort must also be 
considered. The cost of col lection, the burden on respondents, the confusion 
caused by another and likely conflicting data set, and the probable lessening 
of data quality that is associated with ad hoc or first-time data collection 
efforts are not to be minimized. Given that many of the analyses of HEGIS " 
financial data at NCHEMS are atthe detailed or institutional level, these 
difficulties necessitate the use of HEGIS financial data. 

To compensate for some of the limitations In this data set, a/ series of 
assumptions have been made In various applications. For example, In the 
McCoy/Hal stead (McCoy and Ha I stead 1979) study of financing, the presentation 
of state and local appropriations Implies that these funds are applied., to 
educational and general expenditure purposes where In fact they 0 may also be 
used for hospitals, auxiliaries or independent operations. In the absence of 
data In a source/use format, such assumptions are necessary. 

r 

To assure that the uses made of HEGIS* finance data were both appropriate 
and relevant to specific dec Is! onmak Ing. needs, NCHEMS has' always utilized 
experts and constituents in making these assessments. The use of task forces, 
field review of data and reports, peer review by other researchers, and 
subsequent redesign efforts have prov Ided ;a rich source of external Input on 
the data and methodolog^ used In the Center's work. Specif Ic examples of 
changes resulting from puch Input Include a different and more detailed 
categorization of institutions, changes In the measures used in specific 
studies, additional analysis to enhance the relevance of a particular study,' 
and Initiation of supplementary surveys. 



Accessibility of HEGIS Finance Data to Researchers 

As previously indicated, the process of readying the financial data for 
aralvsis i'a complex one despite substantial, accumulated experience with 
the si at "on the' art of this researcher. The documentation associate ^w.t 
the HFGIS tapes is often not sufficient from a user's perspective. While Jhere 
la^been substantial Improvements the documentation prov e by C w 
their data tapes, documentation on older tapes (pre- 976 data) I s ske Jcny-ana 
difficult to interpret. Even with the Improvements in documentat on in recent 
per lots [ill ocume Nation that is provided is too terse (not explanatory 
enouqh) in many cases. Areas where further documentation is needed include: 
P^lSlninS how the universe of institutions changes year to year, how the ... 

records that are distracting and inefficient for analysis. This researcher 
extra eo s malaria, fro. these tapes, and the O-elopment o a =onso Mdated 
experience of past users coula be used. 

Quality of HEGIS Finance Data for Research 

Over the six-year period that this researcher has used HEGIS data, many 
diffeS Institutions, states, and researchers in higher education have 
re ortTd t at tjere has clearly been major improvement n the qua ty o 
repur ieu i . Mpv/prthp I ess Important prob ems remain. A. specific lisnng 

io I ffe re ces pran ces among the states, a survey? has recently- been 

UTnafys T%cll tonTn' t Vc coons' -d for conducting sensitivity 
s?ud"es y ?o determine the Impact of data problems on analytical results. 

Some of the data limitations discovered in analyzing and using HEGIS 
finance data are cor rectab I e errors in reporting A process ma nta.ned by 
KlCES s needed for correcting known data errors. No such procedure exists 
nnw A notent I al solution is the practice of the National Science Foundation. 
■STinJflSSTSl can contac? NSF and'correct any errors for prior years once the 
errors have been Identified. 

2 Ga ll Norris, Executive Coordinator, Washington Council. for Postsecondary 
Education, is spearhead i ng th is effort. 



More typical of the data I Imitations, however, are prob I ems -w I th the 
procedures themselves. Institutions report correctly, but because of 
differences among Institutional and state practices, the data are not 
comparable. For example, certain vocational -technical Institutions are not 
part of the HEGIS universe. In one state, debt service may be paid out of 
current Institutional funds (thus appearing as HEGIS data), but In another 
state It may be handled by a separate agency. In some cases, a researcher can 
analytically compensate for some of the known data problems. For example, In 
the case of differences In the organization of medical schools, It is possible 
through the HEGIS degree file to Identify how such schools are organized. This 
knowledge can be applied analytically to separate reported data for those 
institutions that have an Integrated medical school from, those that don't. 

To address problems associated with existing procedures, NCES should 
authorize a reexamination of financial reporting practices from the perspective 
;Of higher education financial data users, Involving others In that process 
(Institutional data providers, state representatives, and researchers). 
Because any changes that would result from such an effort would not be achieved 
Immediately, continued efforts to highlight these data limitations and to 
caution users of these data must continue. 

Other efforts to Improve data quality could Include: 

Better feedback to NCES from the higher education community of known 
data problems . 

Immediate feedback from Institutions using Institutional profile 
reports 

More use of cross-file editing < 

More Involvement of the states In providing local assistance In 
Interpreting reporting procedures 

More Interaction by NCES staff with. editing contractor to assure 
procedures are followed properly and comp I etel y documented 

Institutional Involvement when editing questions arise about the data 
they have reported . , 



Timeliness of HEGIS Finance Data for Research 

While NCES has made remarkable progress In their release of HEGIS finance 
data, some additional Improvements are probably possible. Such Improvements, 
however, are more dependent on the postsecodnary community than on NCES. ^ 
Reduced response times by Institutions Is one needed step. Efforts by a state 
postsecondary agency to reduce this response time have proven helpful In' the 
Rast and should be continued. Secondly, a shifting of many editing 
responsibilities to the state. level Is likely to provide faster reportlng r and 
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3 However, a regular schedule for the release of financial tapes would greatly 
facilitate the scheduling of research work and hence Its timely release tor • 
use. " t 



Improved data quality. In general, NCES is too removed from the scene to judge 
the accuracy of data! The Maryland example described by Lapovsky I s a good 
case in point! It shows effective state editing to.lmprove comparability and 
speed. , 

Cost-Effectiveness of HEGiS Financial Data for Research 

As stated above, a comparison of i..e cost of d I recti y col lecting f inane i a| 
data from ape-ox i mate I y 3000 institutions with local reporting makes HEblb 
d ftlanc al data high i y cost-effect . ve. Changes in the documentation already 
detailed would further reduce costs. From a general, user perspect ve 
increased publication by NCES of summaries and analyzed reports would make use 
o "these dafa even more" economically feasible. The father development of data 
services to meet the needs of individual users such as institutions would also 
improve the cost-effectiveness of using these data sources. 

While the previous comments relate to the utility of HEGIS finance data 
from a s nqle researcher's perspective, figure 2 provides a listing °f 
ecomme a? ons at various 'stages in the data col lection anc 1 use process for 
different participant groups. Recognizing the shared nature of these 
responsibil ities, agreements to a process of change by each of these 
participant groups is required. 

I 

Steps for the Future , 

In addition to the specif ic recommendations identified in ^9 ure2io 
improve fhe utM ity of HEGIS finance data, the following three genera, steps 
are- proposed: 

1 Develop a plan for broad-based participation in a review of HpIS^ 
Hnancial data. - has been five years since the last set exchanges 
to the HEGIS fi,: e form were imp I em ented. t now seems . 
appropriate- in light of the current recognition of 1 '^Jlonj in 
that data set-to begin a revision. Such a revision should focus 
Ztn on the qual.?y and relevance of the HEGIS finance ? - Users 
of HEGIS finance data should be broadly represented. Institutional 
data providers, NCES, and the research commun ity shou I d also be 
represented. , 

2. Identify the factors that affect the utility of HEGIS finance data and 

2 ank recommendations for changes. While f ive f actors were dent! fled 
in this paper, there are.probab I y additional factors that should be. 

• considered Specific recommendations shoufd be developed in each area 
and then ranked in order to focus the efforts" for change. 

3 Promote the widespread use of HEGIS financial data. Given that , 
improvement n the quality of data are so dependent on .the extent of 

Ts use! It is important that the higher education community should 
work Aether to support the use of HEGIS; to .discourage the 
Srollferat on If duplicative and burdensome data collection efforts; 
. and to conllnue to document I imitations in existing data n order to 
support cautious and informed use of these data, concurrent with 
efforts to improve these data. 
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Figure 2 

Recommendations for Changes In HEGIS Finance Data _Ccl lection 
--" and UsVPiocess 



Participants 



Process 



Provider Institutions 



Data Collector NCES 



Researcher 



Users 



I, Data Collection 
Design 



o Inclusion perhaps 
through an ongoing 
Institutional panel In 
redesign process (NCES 
has state and 
association panels but 
no explicitly 
Institutional group) 



o Additional 
clarification to th-s 
postsecondar^ community 
of why collecting data 
and how they are used 

o Regularize a redesign 
process to evaluate 
needed changes to 
survey* forms 

o Utilization of an 
Institutional panel, In 
addition to the stale 
and association panel 
for input 



o Better articulation 
of research needs 

o More consideration of 
using existing data vs. 
collecting new data 

o If collect own data, 
more use of standard 
definitions, etc, 

o Uso of protests 



Better. articulation of 
research needs/uses 



II, Data Collection 



o Better enunciation to 
collector of problems 
In filling out forms 

o Work with' state 
agencies to ensure 
accuracy (state 
editing) 

o Improved response 
time 



o More efforts to work 
with Institutions and 
states In explaining 
requests, answering 
questions and 
facilitating response 
(recent examples of 
this are the regional 
meetings now underway) 



ML Editing ' 



o Cooperation with NCES 
In the editing process 

o Review any 
Institutional prof lies 
or reports sent and 
correct If necessary, 



o Concern In 
selecting/editing 
contractor for 
continuity and 
cooperation 

o More Interaction with 
contractor on edltlng^ 
to assure policies are 
followed 



o Communicate knowledge 
of any known problems 
to the data col lector 



Communicate knowledge 
cf any known problems 
to the data collector 
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o Initiation of 
cross-file edits using 
frequently used r 
measures (S/student, 
OdPM per ASF, etc J 
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o Creation of a 
multi-year correction 
editing capability 

o Interact more with 
provider for - ■ 
questionable responses 

o Build Institutional 
profile and send back 
to provider using new 
and past data to. aid 
editing process through 
feedback 



o Work with the states 
In edltlng, ; of data ' 1 



IV. Rblease Sample participation o Use a sample for , feedback on usefulness 

for quick release early release of early release 

o Better documentation 
of estimates, 
limitations, tetter 

isj documentatlcn of tapes 

o Develop policies for 
' notifying other parties 
of subsequent editing 

o Continue to develop 
regular reports 
summarizing key data 
findings 



V, Analysis o Assist in development 

of useful analysis < 



o Conduct own analysis 
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o Assist In development 


o Convene 


of useful analysis 


representatives from 


« user, 'provider, . 


o Conduct own analysis 


collectors to'galn 


Input and' methodology 


o Build more detailed 


and data 


Institutional 




classification systems ■ 


o Develop standard 


Into data files 


routines for assessing 3 




the quality of the data 




files-conduct spot 




. verification checks In 




, areas of question 
< 




o Carefully and ' 




analytically select » 




; comparison* groups 



o Identify and document 
all known comparability 
Issues — In areas where 
data permit do 
supplementary analysis 
to compensate (for ■ 
oxample, medical 
schools) 

o Use supplementary 
data collection If 
needed 



o Provide user guidance 
In Interpreting results 

o Peer researcher ' 
review of methods 



o Utilize feedback to 
revise and. further • 

^ develop methods 

^ (through task force and 

other such groups) 



vl * Us | Work with state groups o Develop Information 

1 \ In the Interpretation profiles that are more 

and use of analysis , "mlcro^ln orientation 

to, support further 
detailed analysis 

V 

o Monitor uses of 
Information as a basis 
* for -Identifying needed 
changes 



Fig, 2. Recommendations for, Changes In- HEGIS Finance Data Collection and Use Process 



o Where specific 


o If research Is not,, 


questions or needs 


ful ly understood, 


arise, provide direct 


request clarification 


assistance to those 


from researchers 


requesting It 






o If further 


o If capability 


Information on more 


supports It, provide 


select peer groups Is 


additional detail. for 


needed, obtain It 


user-selected peer 




gorups on request 


o Involve local 




Institutional 


o Provide feedback to 


representatives In ~~ 


data collectors on 


Interpretation and use • 


needed changes 


of Information 




o Work with data 




collectors and 




researchers to Improve 




data and analysis ,. ■ 
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